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ABSTRACT 

The study presented here examines whether an 
ethnographic approach to the study of teaching yields new insight 
into the teaching-learning process. Two-hundred teachers^ who 
differed in measured effectiveness^ were recruited from thirteen 
school districts in the state of California. Each teacher taught two 
experimental teaching units (ETU's) of two-weeks duration. Each ETO 
included an introduction to the teacher^ giving a rationale for the 
unit; performance objectives; pre- and post-examinations for 
students; and a variety of instructional materials and activities. 
After test data were collected^ posttest scores were regressed on 
pretest scores for each grade level. Based on class pretest means^ 
three strata were created: low*, middle^ and high-achieving classrooms 
within each subject area and grade level. Twelve observers were 
selected and trained. This included learning to reau educational 
ethnographies^ practicing in classrooms^ and observing films of 
classrooms. The ethnographers were trained to provide both reading 
and mathematics protocols each day; give informal protocols based on 
observations during recess, talks with principals, and conversations 
with peers; and asked to give a summary protocol emphasizing 
important anthropological concepts useful for studying education. Six 
raters were brought together for two weeks to read a pair of 
protocols a day, describing a more effective and less effective 
classroom. They were asked to describe as many ways as possible that 
the two classrooms differed using any desired terminology. They 
generated 211 dimensions. This list was revised to 61 variables and 
used to do a more extensive study involving 20 raters using specially 
constructed rating forms. (DMT) 
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INTRODUCTION 



The Far West Laboratory for Educational Research and Development has 
been conducting research on teacher effectiveness. Under contract to the 
California Commission for Teacher Preparation and Licensing, with funding 
provided by the National Institute of Education, the Laboratory is studying 
teachers in second- and fifth-grade classes in order to identify teacher 
behavior and classroom qualities that are related to reading and mathematics 
achievement. 

The California Commission is the agency charged with certifying the 
appropriateness of teacher training programs throughout the state. To 
carry out its duties, the Commission needs information about what teacher 
behaviors are related to student outcomes. This information will then be 
used jointly by the Commission and the State institutions that it certifies 
in order to better insure that beginning teachers receive training in 
areas that have been empirically demonstrated to affect student learning. 

To obtain the information they need, the Commission has undertaken a 
multi-year research effort entitled the Beginning Teacher Evaluation 
Study (BTES ). During 1974-1975, as part of this study, the Laboratory did 
work on five major tasks. Three of these were substantive tasks, inquiring: 
^) whether ethnographic approaches to the study of teaching could yield new 
insights into che teaching-learning process; 2) whether the planning and 
decision-making engaged in by teachers is different for teachers who vary 
in their ability to induce learning; and 3) whether the perceptions of 
teachers who vary in their ability to induce learning differ when viewing 
teaching-learning situations, and, of equal interest, whether students' 
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perceptions of the teaching-learning situation would yield information 
about what aspects of classroom interaction were salient and important to 
the students. 

Two methodological issues were also addressed during 1974-1975. One 
of these issues was concerned with the explication of a conceptual model, 
with methodological procedures, in the area of f'me allocation in natural 
classroom situations. It has become increasingly evident to us that 
instructional time is related to educational outcomes. The BTES r.taff is 
continuing to investigate this area. The second methodological issue was 
concerned with an inquiry into general izability theory applie^i to the 
problem of how many observers and/or how many occasions are necessary before 
stable estimates of a teacher's classroom behavior are recorded. 

The goal of these five tasks, as well as some others, was to provide 
information that could be combined with existing data obtained by Edu_^^*onal 
Testing Service during 1973-1974, in order to design a large field study 
examining teacher effectiveness. I shall describe in detail only one of 
our efforts, the ethnographic study. Information about other aspects of the 
study can be obtained from the Far West Laboratory by requesting the BTES 
Technical Reports. 

Identification of a Sample of More Effective and Less Effective Teachers 

A first step in our approach to generate variables worthy of further 
consideration in the study of teacher effectiveness was to identify a 
sample o* .jachers In the State of California who differed in their 
measured effectiveness. Two hundred teachers were recruited from thirteen 
school districts in the State of California. Half were second grade 
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teachers and half were fifth grade teachers. Each teacher taught two 
Experi«„ta1 Teaching Units (ETU's) of two-week's duration each. The 
second grade ETU In reading centered on using word structure as a too, for 
co«.„hens.on. reading for comprehension and content; foHowIng directions- 
and sequencing. ,.e second grade ETU In mathematics focused on the concept of 
measurement. c„,.servat1on. and the associated arithmetic operations 

• - .... 

^ding focused on reading in larger units 

(phra^ 

'le fifth grade ETU in mathematics 

cent 

■i associated arithmetic operations, 
the teacher giving a rationale 

for the ^ p 

t w^re tied to the tests for the 
-t; pretests fo. the :tu.. .. actional materials and activities 

for the teacher to choose from, .nd a posuest for the students. The 
HTU-s conformed to accepted state c.^ricolum objectives for grades two and 
five. 5ut were in areas not ordinarily stressed by teachers in those grades- 
In the second grade, instruction took about twenty minutes a day for f.o 
weeks, and in the fifth grade instruction took .bout forty-flve minutes a 
day for two weeks. The ftij'c: 4.k« 4. 

ETU s in the two subject ..atters were administf^red 

sequentially. 

After the test datawerp rnii^.*. w , 

^awere collected, classroom posttest scores were 
regressed on pretest scores for each ftii c . , 

'^'^ ^TU. separately for each grade level. 

'''' ^^^^^^^^^ --^-^ - ^--ing ^ss- 

r T ''''''' - --t- sample 

one hundred teachers at each grade level., ten classrooms with high 

-.dual gain scores in readin,. mathematics, or both areas, were chosen 
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Ten classrooms with low residual gain scores in reading, mathematics, or 
both areas were also chosen. These classrooms came -^m "^l three pretest 
strata. The ten teachers with classrooms that showed qher than predicted 
posttest means were designated as "more effective" teachers. The ten 
teachers associated with classrooms that showed lower than predicted posttest 
means were designated as "less effective" teachers. It must be noted 
that these designations are relative and that the teachers in the study 
were a -.'olunteer sample. Our procedures can only allow us to tulk of more 
and less effective teachers, as measured in the manner described, and in 
no way implies that these teachers are "good" or "bad" in their regular 
classroom performance . 

The pretest and posttest correlations for the ETU's, In both subject 
areas, and both grades, were rather high (around .90). Correlations be- 
tween residuals across curriculum areas were low, around .30, in both 
grades. In correlating the ETU gains in reading and mathematics with the 
gains from year-long testing using the California Achievement Test and a 
special battery of tests created by the Educational Testing Service, it was 
found that the ETU gain scores over two weeks werj positively related to 
these other more standard measures of gain over the entire year. 

The ETU's and associated tests were designed to identify a sample 
of teachers who varied in measured effectiveness when teaching a cofinon 
curriculum, to common objectives, for controlled amounts of time. On the 
basis of residual gain scores over the two weeks of teaching each ETU, ten 
more and ten less effective teachers at each grade level were identified and 
constituted the known sample of teachers that was used for intensive 
analysis of classroom practice. The ethnographic study I am reporting on 
today was conducted with this special sample of teachers. 



Ethnography in the Classroom* 
Our goal was to obtain protocols of classrooms written by sensitive 
observers who were unaware of the measured effectiveness of the teachers 
they observed. The BTES staff believed that "single-act" psychology and 
hypothesis testing psychology had yielded little of value for studying the 
complex world of the classroom. Thus we turned elsewhere for a way of 
viewing classroom phenomena. Recently, our own feelings of uneasiness 
with traditional psychological approaches have been echoed by others. 
Lutz and Ramsey (1974) have been concerned that the teaching act. and 
learning outcomes that have been studied to date are those that, for the 
most part, can be subjected to measurement by paper and pencil tests and/or 
by the development of behaviorally defined coding systems. Descriptions of 
the activity in a classroom, therefore, have been limited by the "screens" 
through which events have been recorded- those "screens" being soundly 
based from a psychometric quantitative point of view, but lacking in tenns 
of qualitative information surrounding the reality of what actually 
occurred. They soy: 

pn-jteJ^fP.'?^?Erf ^>'^'"=^ some available 

Sr !f c ^'""^ °^ statistical reliability and 

InlJl/J^l^^''''^' ^""^ ^^'^^^ ^3*3 are collected, it can be 
esoSriV *3 ' "TJ^r ^" "suali; much too 

su?h a L%" °^ hypothesis. In 

nn/J^' hypothesis is not grounded, the variables 
ma^ have lit'nr::?^-' irnportant; the operational ^asurls 

tul nul e \'n'^ he" a'mJle'':a^e^eTt'or'??'' r''''' . . 
^•^nn ^^r. i /'''^.^a"P'e, maKe te^t of it much more powerful 

than the hypothesis is compelling (Lutz and Ramsey. 1974. p.5) 
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*The research to be described was directed by Dr. William 
In^l^ilt IT^ f activities is given in Tikunoff. 

and Rist. R.C. An ethnographic study of the forty classrc 



Tikunoff. A 
W., Berliner, D.C. 
p„„. „. „ , , ^ , -. ■ -■ «.•- forty classrooms of thr; 

San FraS?iIco r.'lif'^."?*'°u ^^f^ sample. Technical Report No. 75-10-5 

San Francisco. Calif.: Far West Laboratory for Educational Research and 
Develonment, October, 1975. 
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The result of the shortcomings from research on teaching, and the 
uneasiness shared by many with the intellectual style of " psychological 
research has established an introspectic stance by some educational 
researchers toward their accomplishments to date (Campbell. 1974; Cronbach, . 
1975; Glass, 1972). Such reflection has led to an intensive questioning 
of the research questions which are asked, and therefore, th^- research 
methodology being employed to answer them. It is out of that questioning 
that the impetus has grown to look beyond the methodologies of experimental 
psychology to other disciplines of the social sciences for the purpose of 
studying teaching. Particularly important is anthropology or social 
anthropology and their observational techniques. The use of the direct 
observer, fully imbedded in the on-going process of the classroom, seems to 
be an emerging tool for use in some current evaluations of NIE-funded 
projects (Carripbell, 1974), and the use of such anthropological field method- 
ology over a longer period of time should result in accumulation of more 
qualitative data of. potentially, great utility (Lutz and Ramsey. 1974). Our 
goal must be to gather more au.alitati.v_e information along with the quantitative 
information we usually collect. Campbell (1974) characterizes the contrast 
between ti.ese two approaches: 

l°or SlflfTv-F- ''^f .^Iso scientific, scientistic 5nd naturwissenschaftlich. 
For qualitative read a. so humanistic, humanitistic. geistRswissenschaftlich 
experiential, phenomenologicol. clinical, case studyrfield wo'k ' 
participant observations, process evaluation, and ?ommoi-sense knowing. 

The gathering of such qualitative evidence, suggests Cronbach, involves 
intensive local observation that goes beyond disciplines to an open-eyed, 
open-minded appreciation of the surprises nature deposits in the investiga- 
tive act (Cronbach, 1975). It necessitates the "direct observation of 
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human activity and interaction in an ongoing, naturalistic fashion" (Rist. 
1973). It allows the researcher to: 

File descriptive information ... instead of reporting only those 
selected differences and correlations that are nominally "greater 
than chance." (Cronbach, 1975). 

It was because of the-e concerns and beliefs that an ethnographic study 
was designed and conducted. 

Recruitment of Ethnographers 

The first task was the recruitment of sensitive observers tc send to 
the specially selected classrooms to obtain the qualitative information that 
was desired. The 12 observers finally chosen are described in Table 1. Most 
were doctoral candidates, in anthropology or sociology, and most had served 
as nonparticipant or participant observers previously. 



Insert Table 1 Here 



Training of these ethnographers consisted of 1) reading educational 
ethnographies, including those of Jules Henry and others; 2) practice in 
classrooms; and 3) observing films of classrooms. Protocols produced 
during training were read and critiqued by the Laboratory staff. Three 
weeks of effort was directed into getting the ethnographers ready to focus 
on reading and mathematics lessons in natural classrooms. A sample proto- 
col is given as Figure 1 and should be read carefully to give you a feel 
for the kind of data we collected and worked with. This particular sample 
is a training protocol which was read and critiqued by the Laboratory staff 
during the time the ethnographers were being trained. 



Insert Figure 1 Here 
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Although we were interested in obtaining qualitative information, we 
did not ignore the chance to "calibrate" our data collectors. Table 2 
presents data on that issue. An expert ethnographer was used as criterion 
during some training exercises. From a film clip of a classroom dis- 
cussion he picked nine events that were salient to hfm. The ethnographers 
saw the same film clip and wrote protocols on what they observed. The 
information in Table 2 on percent agreement with the expert is to be inter- 
preted a<; a form of a validity check. The information on percent agreement 
among the raters is to be interpreted as a form of a reliability check. 
All disagreements were used for discussions about recording observations. 
When reliability and validity were judged high enough, these observers 
were sent out into the field. 

Insert Table 2 Here 

Data Base 

The ethnographers were trained to provide: 

1) A reading protocol, each day^ if reading was taught; 

2) A mathematics protocol, each day, if mathematics was taught; 

3) Three to five informal protocols based on observations during 
recess, talks with principals, conversations in the teacher's 
lounge, etc. ; 

4) A sunmary protocol emphasizing important anthropological concepts 
useful for studying education. These concepts include competi- 
tiveness, work ethic, patriotism, play ethic, etc. 

Thus the data set, with one ethnographer observing for one week in 
each c^^^^sroom includes five reading protocols, five mathematics protocols, 
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at least three informal protocols, and one summary protocol done after 
observation was completed. Four weeks were required to collect data from 
all the teachers in the study. All data were collected blind. The v>ihno- 
graphers had, typically, two more effective and two less effective teachers 
to work with and worked only at one grade level. Classroom notes were read 
into a cassette recorder each day and seit to the Laboratory for immediate 
transcription. Teams of typists helped to turn out thousands of pages 

describing classrooms of these teachers who were known to vary in 

measured effectiveness.. 

At this point you now have knowledge of how this particular sample 

of teachers were chosen, what the goal of the study was, what the training 

of the ethnographers was like, and a description of the data sets obtained 

in each of forty classrooms. 

Generating Dimensions 

Six raters were brought together for two weeks to read a pair of 
protocols a day. One protocol described a more effective classroom and 
one protocol described a less effective classroom. These raters included 
one expert in classroom observation instrumentation, a classroom teacher, 
a curriculum coordinator, one graduate student in educational psychology, 
and two ethnographers who were thought to write very sensitivr descriptive 
protocols. The raters were asked to describe as many ways as possible that 
the two classrooms differed. They were free to use any terwinology they 
wanted. They were aware that they had a more effective and a less effective 
classroom paired together, but they did not know which classroom was 
which. The hope was to keep this task relatively hypothesis free and at a 
common sense level. To help them in their task the raters used cards like 
those presented in Figure 2. This task was, essentially, a concept-definition 
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task. At the end of each day, the raters came together and shared their 
concepts. Each rater helped other raters define the concepts and each 
provided exemplars and non-exemplars of the concepts from their own proto- 
cols. The list generated by these raters contained 211 concepts. ThesG 
concepts are presented in Table 3. 



Insert Figure 2 Here 
Insert Table 3 Hera 



Remember, that each of these sometimes exotic variables, dimensions 
or concepts was linguistically defined in a rather precise manner. Thus 
concepts like "psychotic autism." or a view that "children are evil." were 
concepts that we had no preconceived desire to work with. But they were 
chosen as concepts that differentiated between more and less effective 
classrooms by at least one of the raters and the concepts were agreed to. 
refined, and defined, by the other raters. We purposefully did not place 
any limits on the type of concepts that could be generated. To this list 
eight additional concepts were added. These included five concepts from 
Kounin's (1970) work (withitness. smoothness, transitions, etc.). and three 
variables that were experimentally manipulated in a study conducted at the 
Stanford Research and Development Center. It was thought that an independent 
correlational check of those variables could be made in this study. 

The list of 211 dimensions was much too big to work with and contained 
a good deal of overlapping concepts. The dimensions were combined into 
61 variables which were thought to capture most of what the "dimension 
pickers" had chosen. Variables were also chosen on the basis of whetK.r 
or not they appeared frequently in the protocols. The final list of 61 
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dimensions, and brief definitions, is given as Table 4. A 'T' or "S" 
denotes the variable as related to the teacher or the student as the focus 
of observation. These 61 variables wtre next used to do more extensive 
analysis of the protocols. 

Insert Table 4 Here 

Twenty raters from all walks of life were brought together to rate 
pairs of protocols forthe presence or absence, or the occurrence of more 
or less of the variable. They received training in the use of a specially 
constructed rating form and in understanding the definitions for variables. 
The rating forms used in conjunction with the manual defining each ov" the 
61 dimensions is given as figure 3. A sample of the rating manual is given 
as Table 5. Each variable is cU&rly defined and examples of each variable 
are taken directly from the protocols that describe natural classrooo 
behavior. . 

Insert Table 5 Here 

Insert Figure 3 Here 

Ten raters worked on second grade reading protocols and then were 
switched to work on fifth grade mathematics protocols. Ten other raters 
worked with fifth grade reading protocols and then were switched to second 
grade mathematics protocols. Each rater received a protocol of a more and 
a less effective teacher, according to the sampling plan presented as 
Figure 4. Each of the ten more effective teachers were treated as an 
interchangeable set and each of the ten less effective teachers were viewed 
as an interchangeable set. Pairs of classes were randomly picked for raters 
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to examine. Out of the total 100 pairs possible, 32 pairs were rated by 
one rater, and four additional pairs were rated independently by two raters, 
When this process was repeated for each category (reading and mathematics, 
second and fifth grade) we had sixteen reliability checks nested within 
the actual ratings. Within each grade and subject matter area 36 pairs 
of classrooms were compared. Each more effective classroom was compared 
three or four times with a less effective classroom. 



Insert Figure 4 Here 

Findings 

Table 6 provides the summary data from this study. The simple binomial 
test was used to examine the ratings. Thirty-six opportunities for rating 
occurred, thus a split of eighteen and eighteen would have meant that the 
dimension, say "abruptness", was found eighteen times to be rated as 
occurring more often in the less effective classrooms and eighteen times to 
have occurred more often in the more effective classrooms A split by the 
raters of twenty-two and fourteen has a probability of occurrence of .09 and 
a split of twenty-three and thirteen has a probabi li ty of occurance of .05. 



Insert Table 6 Here 



This Table reveals that there are twenty-one /ariables that were generic. 
That is, these variables discriminated between more and less effective teachers 
in second grade reading, second grade mathematics, fifth grade reading, and 
fifth grade mathematics. Variables such as "teacher monitors learning 
(No. 37)," and " students are engaged (No. 19;," were consistently associated 
with the more effective teachers. A variable such as "teacher belittles 
students (No. 7)" was consistently found in the less effective teachers class- 
rooms, regardless of the subject matter taught or the grade level examined. 
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other variables were significantly associated with the more or less 
effective teachers within a single grade of a single subject matter area. 
And some variables were associated with effectiveness only in a particular 
grade x subject matter context. All 61 variables were slgmficantly 
associated with the measured effectiveness of the teachers at least once 
when the various combinations of curriculum area c.nd grade level were 
examined. 
Concl us ion 

As our -work continues each of these variables will be given closer 
examination in partial replications. In that way increased assurance about 
the validity of these variables for differentiating more and less 
effective teachers will be obtained. For now, this work meets the project 
goal which was to generate variables of promise in the study of teacher 
effectiveness. Both the methodology used and the results of this study are, 
in the opinion of the BTES staff, worth further investigation. 
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TABLE 1 

Background of Ethnographers. 



Ethnoqrapher 


Most Recent School 


Anthropology/ 
Sociology 
Degree Proqrams 


Number of 

Participant 
Observation 


Ph.u 


M.A. 


A. 3. 


ExDeripnr#< 


1. 


U.C. Santa Barbara 
Ph.D. Sociology 


X 


X 


X 


3 


2. 


Stanford University 
Education 






X 




3. 


Stanford University 
N.A*, Communications 








n 

V 


4- 


U.C* Berkeley 
Ph.D.. Sociology 
of Education 


X 


X 


• 




5. 


San Francisco State 
M.A. , Sociology 




X 


X 


2 


• 6. 


U.C. Davis 
Ph.D.* Sociology 


X* 




X 


5 


7. 


U.C. Santa Barbara 
H.A. , Sociology 


X* 


X 


X 


2 


8. 


U.C. Berkeley 
Ph.D. Sociology 


X*' 




.X 


1 


9* 


U.C. San Francisco 
Ph.O*, Sociology 


X* 


X 




1 


10. 


Stanford University 
N.A.» Anthropology 


X* 


X 




0 


U. 


Stanford University 
M.A., Anthropology . 


X* 


X 




1 


12. 


San Francisco State 
N.A., Sociology 




X 


X 


3 



•Ph.D. candidate 
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TABLE 2 



r 

Events Observed 
in Film Clip 



E thnographers 



% Agreement 
with Trainer 
by item 




Agreement 
Among 
[Ethnographers 



Mean agreement: .b7 
* Ethnographer 9 was absent due to illness. 
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TABLE 4 

61 .Dimensions for Comparing Known Sample Classrooms 



'"'"P^l^nLilln , "t"-I^!P"!^ "switching" by teacher, e.g.. fron Instruction to classroom management, to behavior 
managenent, to instruction, to behavior management. si" ueiiaviui 

2. aeceptinq (T) : teacher reacts constructively (overt, verbal, non-verbal) to students' feelings and attitudes 
3- .ac!tJ?t involvement (C) : adult£ other than the teacher are allowed to instruct. 

4. attending (T): teacher actively listens to what a student is "saying, reading, reciting. 

5. awareness of developmental levels (T) : teacher is aware of a student's emotional, social educational needs and 
therefore assigns tasks appropriate for these. 

6. b eing liked (T) : teacher seeks approval from students in an .Ingratiating manner, often at expense of instruction. 

7. belittling (T) : teacher berates child in front of others. 

8. competing (T): competition, outdoing others is emphasized by the teacher. 

^- complimenting (control) (T) : teacher's action reinforces student(s) whose behavior is in the right direction. 
consistency of message (control) (T) : teacher gives a direction or a threat and follows through with it. 
""""''Itudents-jt uden^^"' ^""^^^'^"^ ""^"^^ *° classroom interaction: good feelings between teacher-students. 

12. cooperation (S) : students cooperate with other students, teacher; willingness on part of students to help each other. 

13. defending (T): teacher defends a student from verbal or physical assault by another. 

14. defiance (S): a student's open resistence to teacher direction; refuses to comply. 
^^Js^es.'e'tl^"" opportunities to involve students in decision-making re class standards, instruction, 

16. distrust (T) ; teacher expresses doubt for validity of student's work or behavior. 

17. grilling (T) : teacher emphasizes regularization. rote memory, retrieval of facts on part of student learning. 

18. encouraging (T): teacher admonishes student effort in order motivate them. 

19. engagenent^(S) : students express eagerness to participate, appear actively, productively Involved in learning 

20. equity (T) : teacher appears to divide her time, attention equally among all students. 
'^^'^^TTi^scus^^ «^'»"^ '•-^^1. Class, ethnic contributions; encourages 

22. excluding (T) : teacher banishes student from class. act1v1ty~to corner, cloakroom, out of room. etc. 

'^ll^Jfstu;ert^"";a^\^;jSu^"."^''°^"^^^/'-°'^ '.'^''^'^ °" ""1== °^ P«t infor- 

?4. filling time (T); teacher fills "empty" time periods with "biisy wort". 

"'"or^clgo f s'"d;n;s''^eh::ion""""^°" '° ="^"3^ ^" P^-^^' absenteeism. 

16. gendering (T) : teacher assigns roles on basis of male or female (boy-girl) and reinforces these. 
27. harrassing (T) : teacher taunts, pesters, nags, hazes, -puts down." or physically hits a student. 

''''''' 'PP"" *° deliberately "not hear" or "not see" so as to treat a student as being Invisible. 
39. Illogical statements (T) : teacher makes a statement whose consequences would be ridiculous if carried out. 

^^ ^t!i^l;'^ani^ interestr '° ''''' '° '^^^^^^ individual 
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TABLE 4 (Continued) 



31. 
32. 
33. 
34. 

35. 

36. 
37. 
38. 
39. 
40. 

41. 
42. 
43. 
44. 

45. 
46. 



job satisfaction (T): teacher sears to enjoy teaching. " " 

i^Iiadeda^oLsMb^ teacher see.s confident in teaching a given subject, and de„K,nstrates a grasp of It 
miM^Mor^: student is able to get on denand a desired response fro. the teacher. 

'^^^^^han^rt^"ll^^"ig'n^"^L^^s^^"^^ ^"""-^ t^^^- -"-s students to work at places 

'"°^'^'^y (T) : teacher moves spontaneously about the room. * 

!!-^^lmnjnl^^ students copy teacher's behavior, and are encouraged to do so by teacher 
.onitorin, learnin, (T) : teacher checks in on student's progress regularly and adjusts instruction accordingly 
"''^^""'^ ''''''' ^--^-^ b^-^ness. verbally expresses Ideal behavior .odel 

onenessJll: teacher treats whole group as a "one" often In order to maintain peer control. 

'^?iili^-'neSd"^:r'"se"???:j?o:^t^:^'^^" '° ^'""^^"'^ ^"^^"^^ °^ or frustration, admits mistakes, ex- 

open .uestioninc, ( Tl: teacher asks .uestlons which call for Interpretive responses and are open-ended 
OEiifnlsEJli: teacher expresses positive, pleasant, optimistic attitudes and feelings 
^CM: teacher appears to perceive learning rate of students and adjusts teaching pace accordingly 
'''''^M|i;s"rs%^^^^^ and are encouraged to do so. whether "olders" 



personalizing (T): teacher calls on students by na^e. 



47. 

48. 
49. 
SO. 
51. 

52. 
53. 
54. 
55. 
56. 
57. 
58. 

59. 

60. 

61. 



''^^^f?Hl5pfn=.fl???|:.™'""'' -Pl.^.- .nd -thank „„-. .„c,u„c,„ „™ ,„ 

praising (T): teacher verbally rewards student. 

P..oo..n, „ ^^^^^^ ^^^^ ^^^^^ 

..c.,..t„n-,..>,n, ,T„ t„c... „„s attention t. n. „p..ent ,n,t™ct,-.n., p„n.,.e 

''''^i.n':^^^^^;?!.r^2;:n^r^f;fs,?^'::;^! • or tn-^ t,.. t, « 

'^^'^^ ' """""'"S de,tr„ct1../c„tt,n, remarks 

l!-!i!lIU: teach.. :.t„„ ,„„t ,n students th.,. ».ha„.. ,„ „ estaM.s. c.nt™, 

""^'^ .= can,. st.;ent,. ..ha^.,. 

teach.. capna„„, ,„..ct,.na,„ on ..«„ct« ,„c„.„t, tnat aH» .Hn, c,a. t,.. 
^^rlMi: ..ac... ,a..,,. an. ...nt, s,c,.-.c.n«c, .thn.c. „c,., charact...,./ 

^^JMI: t.ach.. p.,a.. .t«.„t, ,„„„ ^^^^^ 

^^^^^f^ilfrjlliJll: teach.. p.,„„ ,n,t™ct„na, «t.MaU ,th.. than .-..tt,,.. an. ..,n,.s t..i' 

i»L^|iIIl: t.acn.. „pha„„, p™,. ^^^^^ ^^^^^^ ^^^^ ^^^^^^^ 

"^^^it 4:pXr2;?i4 s:";:;.- r.sp.ns.3 .„ts ,» s.i.„. art.. 

'-"^^ " ".th .h„ .,,.ct„n ..war. th-. 



TABLE 5 
Example from Raters Manual 



ABRUPTNESS (T) 
Me m ean: 

~ ■ » 

- teacher changes from one activity or lesson to another without 
advising students 

- unanticipated change without "tying up" what was in progress 

- pupils surprised or confused by teacher's change in behavior 

- teacher switches from instruction to behavior management and 
back again 



Examples : 
1 



3. 



Teacher, Okay, get out your readers and turn to page 195." 
Students, "But we haven't finished our math worksheet." 
Teacher, Sorry, maybe you can find time to do it later." 

During reading lesson, teacher is listening to students 
in a small group reading aloud. Several times she inter- 
rupts whoever is reading in order to administer discipline 
to someone in another part of the room. 

Studer 3 have been working diligently, but noisily. After 
several warnings, teacher says, "All right. Put your 
books away. Since you already know the materials, it's 
quiz time." 



We do not mean : 

" smooth transition between work periods 
— eases in from one activity to the next 

Examples : 

1. Teacher makes sure that students understand what they are 
to do before starting the activity. 

2. Teacher systematically monitors work, gives assistance 
when or before it is needed. 

3. Before math begins students may get a drink and relax 
for a moment. Then they get their math books and papers 
and begin their work. papci- 
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Protocol Nuirijer: o6 
Name of Researcher: 
Date of Observation 
Subject of Observat 



8:30 Noise level 2 



8:35 



Gail 

ion: 
1 
2 
3 
4 
5 
6 
7 
8< 
9. 
10, 
11, 
12, 
13, 
14, 
15, 
16. 
17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 
31. 
32. 
33. 
34. 
35. 
36. 
37. 
38. 
39. 
40. 
41. 
42. 
43. 
44. 
45. 
46. 
47. 
48. 
49. 
50. 
51. 
52. 
53. 
54. 
55. 



2nd Grade Class, Open Class- 
. room, with two team teacher and two other adults, this 
. Is a joint observation with Elizabeth. I will be 
. observing two rcadinq groups today, simultaneously, 
. including 9 diildren. Out of the nine children, 2 are 
. girls , 7 are boys. 

. At 8:30 the noise level is 2. The children have just been 
, let into the classroom, taking their coats off and 
. wandering around the room. Several boys are in the corner 
. fighting, and so^^e girls are sitting on the floor 
, playing a puzzle. The teacher is walking back and forth 
, in the back of the classroom not attending the children. 
The noise continues and the children are running 
around. There is much confusion in the roon. Two teachers 
stand at the desk talking to one another. At 8:35, 
Mrs. Tyler leaves the room. The team teacher 

stays seated behind the classroom at her desk. At 8:40 
Mrs. Tyler comes back into the room. She walks to the 

desk at the far left hand side of the classroom, 
which is a round table, and sits on the edge. She says 
"Blue Group, get your folders and go up in the front. 
Green Group, come here." Noise level drops to 1, and 
the children begin to follow her orders. She says, 
"Anybody loose a quarter." No one responds, and she 
repeats the question again with irritation in her voice. 
She says I knov/ soireone found , someone lost a quarter 
because it v;as found in the coat room. Look in your 
pockets and see." No one says anything. She now 
stands up and pulls a pile of workbooks from across the 
table over to her. They are the reading work- 
books. She opens one of them on the top and says, 
"Ah Daniel I" She says this with a loud sharp voice. 
She continues, "Your work yesterday was not too bad 
but you need some work. Evid^tly there are still some 
words you don't understand.". She thumbs through the rest 
of his lesson. Dannv is standing at the outside of 
the circle around her, not listening to what she is saying. 
Mrs. Tyler now stands and gives instructions to the Green 
Group. She tells them to go through 8 throuqh 13, reading 
the two stories betv-yeen those pages and to go over the 
work in the workbooks that she is about to give back. 
She tells them that they may seat any place but 
not together and she says, "And I don't want any funny 
business." She now opens the next workbook which is 
Nicolle's. She tells .Nicole that she is having the 

same problem that Danny is having without specifying 
further. Nicole lockr up at her with an expectant look 
on her face. She then looks at a third book and says 
Michelle you're naving the same problem. She says, 
"Snatch means to grab. Beach, what does it mean? Michelle 
doesn't answer. Sne'has her finger in her mouth and looks 
anxious. The teacher closes the workbook and pushes it 
to Michelle. Michelle takes it and walks away, with 
Nicole. Teacher then opens the next workbook and says, 
Mike, I don't appreciate all these circles. She points 



Figure 1. A sample protocol 
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We are looking for THINGS THAT DISCRIMINATE BETWEEN CLASSROOMS. When you find 
DESCRIBE IT; 



one 



A. f^^tn^^Y '"^^^'^ ^"""^^ ^'^"^ (descriptors, characteristics, connotations. 



B. What it is not (antonyms, descriptors, characteristics, non-examples) 



GIVE EXAMPLES; 
1. 

2. 

3. 

LABEL IT: 



Figure 2. Teacher, Student, or Instructional Characteristics Card 
for Generating Dimensions. 
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Name of Rater: 
Date: 

Classrooms being compared: 
Grade Level: 



Subj ect 



1- Abruptness (T) 



less 
2 

_J 



3 

-L 



4 

_L 



5 



more 



2. Accepting (T) 



less 



4 



5 

_L 



more 
6 

J 



3. Adult Involvement (C) 



less 
2 

-J 



4 

_L 



5 

J_ 



more 
6 

J 



7 

_L 



4. . Attending (T) 



Awareness of developmental 
levels (T) 



less 



J L 



less 



1 
1 



4 



4 



5 

X 



5 

X 



more — ^ 

6 7 
J I 



mora 
6 

J 



7 
1 



6. Being liked (T) 



less 



1 

L 



3 

X 



4 

X 



more 



6 

X 



7 

-JL 



Figure 3. Classroom Comparison Instrument on 61 Dimensions. 
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Figure 4. Second Grade Reading: Paired Comparisons of Known Sample Teachers 
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